AUTOMATED RIP TIDE DETECTION SYSTEM 



FIELD OF THE INVENTION 

5 

The present invention relates to the field of water safety 
at public swimming beaches. 

BACKGROUND OF THE INVENTION 

10 

13 Lifeguards warn people about rip tides at public swimming 

IQ beaches, such as along ocean beaches. Based upon experience they 

are trained to visually spot rip tide flows, since rip tides have 
jy three basic characteristics that are different from normal waves. 
1^5' First, rip tide wave patterns are perpendicular to the 

]^ shore, which is why they rush out to sea so fast and endanger 

swimmers caught within the pulling power of the rip tide. In 
□ contrast, normal ocean waves strike the shore obliquely, and this 

cushions their impact. Therefore normal ocean waves bounce off 
2 0 the sand at an opposite oblique angle in a flow rate that is 
rather slow. Lifeguards are trained to spot rip tide water 
flows going back perpendicular to the shore, as opposed to the 
oblique configuration of normal ocean beach waves. 

Second, the coloration is different. Rip tide waters are 
2 5 generally darker than normal waters. 

Third, rip tides may have more surface ripples and 

1 



texturing. 

Related art in non-analogous fields include "Kidnappers 
beware! New software can nab you", Machine Design . May 3, 2 001 
issue, page 48, wherein there is discussed a computerized system 
5 which mimics human analysis of handwriting samples; using 

recognizable features such as shapes and spaces. Furthermore, in 
"Face identifier uses neural network". Laser Focus World , May, 
2001 issue, page 90, a system is described for training a 
computer with many examples of images of faces entered into the 
10 system with a digital camera, to assist the computer in 
□ identifying specific human faces. 

;B However, it is not known to use computer analysis of common 

ocean rip tide characteristics to predict the presence of an 
iTJ ocean rip tide. 
1:5 

:!f OBJECTS OF THE INVENTION 

It is therefore an object of the present invention to assist 
experienced lifeguards in detecting rip tides in their vicinity 
2 0 by computerized image analysis of a number of telltale traits, to 
differentiate rip tides from normal ocean waves 

It is also an object of the present invention to utilize 
video camera images to supplement human vision in spotting rip 
tides . 

2 5 It is yet another object of the present invention to analyze 

computer-generated images to detect the presence of rip tides. 
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It is a further object of the present invention to provide a 
computerized video detector for rip tides which mimics the manner 
in which a human observer would perform the detection. 

It is also an object of the present invention to provide a 
5 surveillance of a shore swimming area by a video camera for 
detecting rip tides . 

SUMMARY OF THE INVENTION 

10 In keeping with these objects and others which may become 

Q apparent, the present invention includes a system to assist 
m lifeguards in detecting rip tides at an ocean beach, by visually 
fU capturing and analyzing common repetitive features of rip tides. 

For example, rip tide waves are different from normal ocean waves 
15 because rip tides strike the shore in a generally perpendicular 

fashion and bounce back sharply, as opposed to normal waves, 
]^ which contact the beach shore at a slanted angle and return after 
dissipating much energy. 

The system also detects rip tide waters which may be darker 
20 and which may have more surface texture, such as ripples, than 
surrounding water. 

In the present invention, camera images are substituted for 
human vision, and computer analysis of these images is used to 
detect the presence of rip tides. The analysis involves some 
25 image pre~f iltering that enhances the telltale signs of rip 
tides . 
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In one embodiment, the computer analysis of the system 
utilizes expert systems of analysis, which mimic how a human 
observer would perform the detection. 

Alternatively, in another embodiment, the computer analysis 
5 of the system utilizes a neural network, which trains the system 
with many examples of images of common rip tide patterns, and 
then allows the network to decide whether a digitally captured 
image of a wave pattern is a rip tide wave or a common wave. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

m The present invention can best be understood in conjunction 

m with the accompanying drawings, in which: 

1^5 Fig. 1 is a front elevational view of a beach scene with one 

]^ embodiment of the system of this invention; 

Fig. 2 is a front elevational view of a beach scene in 
close-up, illustrating a rip tide under surveillance by the 
2 0 system of this invention; 

Fig. 3 is a perspective view of the video and surveillance 
hardware of this invention; 

25 Fig. 4 is a hardware block diagram thereof; 
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Fig. 5 is a flowchart of the construction of one einbodiment 
of the present invention utilizing an expert system of analysis; 

Fig. 6 is a flowchart of the construction of a another 
5 embodiment of the present invention utilizing neural network of 
analysis ; and, 

Fig. 7 is a flowchart of a rip tide detection using the 
present invention . 

10 

O DETAILED DESCRIPTION OF THE INVENTION 

ly It is well known that experienced lifeguards can detect rip 

y tides in their vicinity by a number of telltale traits. They 
1^5 differentiate rip tides from normal ocean waves because rip tides 
]Z strike the shore directly and bounce back sharply, as opposed to 
■j' normal waves which hit the shore obliquely and dissipate their 
energy before bouncing back. Also, rip tide waters may be darker 
and may have more surface texture than surrounding water. 
2 0 In this invention, camera images are substituted for human 

vision, and computer analysis of these images is used to detect 
the presence of rip tides. The analysis involves some image pre- 
filtering that enhances the telltale signs of rip tides before 
the digital data is processed for classification as NORMAL or RIP 
25 TIDE. The classification itself can proceed along either of two 
lines . 
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One well known method is expert systems which mimic the 
manner in which a human observer would perform the detection. 
The subtle rules used by a human are codified and used as the 
basis for classification software. The Machine Design publication 
5 reference noted above relates to such an approach to determining 
authorship of handwritten documents by a program written at the 
University of Buffalo. Like an expert handwriting analyst, the 
software extracts features such as individual character shapes, 
descenders, and spaces between the lines and words. 
10 A second well known method is to build a neural network, 

O train it with many examples of images with known classification, 
in and then let the network determine its own classification 
ilj criteria. In practice, most neural networks are simulated in 
hj software on digital computers such as PC's. The Laser Focus World 
15 publication reference noted above relates to such a system at the 
University of Tsukuba that uses neural networks to distinguish 
images of faces which are entered into the system using a digital 
camera. 

Figure 1 shows a beach scene with beach sand 1, ocean 5, 
20 lifeguard perches 2, umbrellas 3, and warning flags 7. The system 
of this invention is housed in an enclosure 8 with the assistance 
of camera 4 atop the umbrellas 3. The area under surveillance by 
each camera is schematically depicted by rays 6 . 

Figure 2 is a close-up also depicting a rip tide area 9 
25 which is about 40 feet wide at the shore line. 

The physical hardware is shown in Figure 3. A camera 4 in a 



weatherproof enclosure is shown with wide angle lens 15. It is 
connected via cable 3 0 to a laptop computer within weatherproof 
enclosure 16 with transparent glazed display panel 17 (glass or 
polycarbonate) and transparent waterproof flexible cover 18 over 
5 the keyboard. This affords full operation for system checkout and 
Start-up, When not needed for manual interaction, the laptop 
computer is further protected with reflective panels 21 and 22 
which are rotated in place over panel 17 and cover 18 using high 
friction piano hinges 23. 
10 Although a commercially available laptop computer is used, 

Q it is modified to accept external cooling via direct impingement 
m from fan tray 26 which obtains its inlet air through replaceable 
ly filter 31 and exhausts heated air through outlet louvers 24. 
\i} A large capacity external battery module 2 5 is also used to 

13 power the entire system. In operation, a freshly charged battery 
]^ is exchanged with the depleted one every morning at the start of 
the surveillance shift. Attachment brackets 19 with key lock 
retainer 20 provide easy attachment to the life guard perch 2. An 
annunciator module 27 contains a bright red flashing warning 
20 light with strobe 28 and an audio amplifier with loudspeaker 29. 
Figure 4 is a block diagram of the hardware of this 
invention. Camera module 4 can be implemented as a surveillance 
type CCD video camera such as National Electronics model NL6124 
with 480 lines of resolution in a weatherproof enclosure such as 
25 Sepco model VCH-100. Both of these units can be obtained from 

Allied Electronics of Fort Worth, Texas. Such a camera requires a 



frame grabber 40 board to sample and digitize individual video 
frames of data. 

An alternative is to use a high resolution megapixel camera 
such as a model CV-M7 which is available from JAI America of 
5 Laguna Hills, CA. This has a native digital interface which 

dispenses with the need for an external frame grabber 40; it is 
connected directly to laptop computer 41 via a Universal Serial 
Bus (USB) or Firewire interface. 

Laptop computer 41 can be any one of a wide variety of 
10 powerful commercially available types such as a Compaq series 
n 1800 featuring an Intel Pentium III processor module. Large 
IB capacity battery module 2 5 supplies power to camera 4, laptop 41, 
iU fan tray 42, visual annunciator module 43, and audio power 
jjj amplifier 44. Laptop computer 41 has on/off control over visual 
15 module 43 and provides the audio alarm or vocal message to audio 
amplifier 44. 

ri While a laptop computer is preferable, standard desktop 

■"f computers (not shown) may be utilized by remote wireless or cable 
connections to the camera module 4. 

2 0 Figure 5 outlines the procedure to construct an expert 

system in software to detect rip tides. A first step is to 
interrogate one or more experienced life guards or oceanographers 
and have them classify live situations which are simultaneously 
video taped. Further discussions of distinguishing clues from the 

25 video tapes enables the compilation of classification rules for 
detecting rip tide episodes . 
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For example, color or darkness, surface texture, wave 
patterns, and interactions of these characteristics are all 
elements which enter into the rules defined. The actual visual 
image is subjected to a number of pre filters to highlight each 
5 of the characteristics of interest. Each filter can define a 

"layer" outlining spatially different characteristics. Brightness 
mapping or color mapping is of use. Fast Fourier Transform (FFT) 
analysis creates another layer outlining areas of enhanced 
surface texture. Duration or sustainability of these features as 
10 well as registration of regions on the different layers are other 
O factors manipulated by the rules defined. While normally it may 
m be considered to be too high a computation task for a lap top 
ly computer, but it must be realized that a frame rate of about at 
iJj least three per second is all that is required for this analysis. 
X5 Also, the analysis may not be continuous. There can be breaks in 
the actual frame sampling, if necessary, to permit the computer 
to catch up with computations of a series of consecutive frames. 

After the rules are initially compiled, they are used to 
classify the video tapes as if they were live camera surveillance 
20 frames. If the accuracy of classification is not up to pre- 
established standards (both false negative and false positive 
rates) , the rules are modified and refined in an iterative 
manner. Testing on a second batch of tapes not used in defining 
the rules is the last step. Once this process is finished, 
25 software for both the pre-filters as well as the rules is now 
available and can be replicated and deployed to each system of 



this invention to perform live beach surveillance of rip tide 
episodes . 

In an alternative embodiment of this invention, as shown in 
Figure 6, a neural network approach is taken. The first step is 

5 similar to that in the expert system construction. Many live 

video tape snippets are recorded and classified by live experts. 
These should be rip tide as well as a wide variety of non rip 
tide conditions. These snippets are randomly assigned to three 
sets, a training set and a plurality of test sets, preferably two 
10 test sets. Using knowledge of neural networks as well as the task 

i3 at hand, the neural network is configured along with any pre 

filtering of the video imaging. This network is simulated using 

m digital code which simulates neural networks. 

Uj In the Laser Focus World publication reference noted above, 

1'5 a self organizing map (SOM) was the type of network used for 

identifying human faces, A similar technique may or may not be 

H applicable. The network is trained by the training set and then 

P used to classify the first test set. If the pre-established 

criteria is met or exceeded, the task is finished. Otherwise more 

2 0 training is done with the first test set and then the network is 
tested with a second test set. If criteria is still not met or 
exceeded, the image filters and/ or neural network are modified 
in an iterative manner until criteria is met. At this point, 
software for both the neural net and pre filters is available for 

25 replication and deployment to field units. 

Figure 7 is a flowchart of rip tide detection using software 
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constructed either as an expert system or as a neural network. At 
this level of detail, the operational flow chart is identical. A 
new frame image from the camera is captured by the system. This 
is fed into the pre filter software. The classification code uses 
the new filtered frame data as well as previously captured frame 
data to make a determination of the current conditions in the 
water; i.e., ''Has a riptide been detected?" If it has not, the 
system simply proceeds to acquire the next frame image. If a rip 
tide situation has been detected, the alarm is deployed. While a 
single alarm may be used, preferably the alarm is sounded in both 
a visual and audio manner (siren and/or voice announcement) until 
a manual reset is detected. At this time, the alarm is turned off 
and surveillance of rip tide conditions continues. 

It is further noted that other modifications may be made to 
the present invention, in conjunction with the scope of the 
invention, as noted in the appended Claims. 
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